Summary:
The characterization and analysis of hand gestures are challenging tasks with an important number of applications in human–computer interaction, machine vision and control, and medical gesture recognition. Specifically, several researchers have tried to develop objective evaluation methods of surgical skills for medical training. As a result, the adequate selection and extraction of similarities and differences between experts and novices have become an important challenge in this area. In particular, some of these works have shown that human movements performed during surgery can be described as a sequence of constant affine-speed trajectories. In this article, we will show that affine speed can be used to segment medical hand movements and present how the mechanical energy computed in the segment is analyzed to compare surgical skills. The position and orientation of the instrument end effectors are determined by six video photographic cameras. In addition, two laparoscopic instruments are capable of measuring simultaneously the forces and torques applied to the tool. Finally, we will report the results of these experiments and present a correlation between the mechanical energy values, dissipated during a procedure, and the surgical skills.
Keywords: Affine speed, hand gesture classification, energy, hand motion representation
JCR Impact Factor and WoS quartile: 1,317 - Q4 (2018); 1,700 - Q3 (2023)
DOI reference: https://doi.org/10.1177/0954411918768350
Published on paper: June 2018.
Published on-line: April 2018.
Citation:
J. Cifuentes, M.T. Pham, P. Boulanger, R. Moreau, F. Prieto, Gesture segmentation and classification using affine speed and energy. Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine. Vol. 232, nº. 6, pp. 588 - 596, June 2018. [Online: April 2018]